Wearable Device System and Method for Detection of Unintended Movement

ABSTRACT

The invention relates to an electronic wearable device designed to detect unintended movement that occurs immediately prior to a firing event of a gun. The wearable device encompasses at least one sensor, such as an accelerometer, a gyroscope and Electromyography (EMG), to detect a flinch movement that can occur prior to the event of a gun being fired. The user or firer can then be provided with real-time feedback on whether a flinch occurred or not during a firing practice. Feedback can be given to the user, in one embodiment, in the form of an audible tone or a vibrating motor in the wearable device.

FIELD

The present invention relates to the field of firearm accessories duringlive fire training. In particular the invention relates to a wearabledevice system and method for detection of unintended movement whileshooting a firearm or the like.

BACKGROUND

When firing guns, accuracy can be affected by what is termed as“flinch”. A flinch is a subconscious reaction, or a reflex movement, tothe firing of the gun, usually just before the gun is fired which causesmovement in the gun and decreases the firer's accuracy. A flinch isnormally so close in timing to the event of the gun firing that theoccurrence of the flinch can be completely masked from the firer by themovement of the gun during the firing event. Thus a firer will oftenonly be aware that a flinch has occurred after having paused firing toexamine the target.

Traditionally the only way to train for flinching was by the use ofinert rounds, known as “snap caps” or “dummy rounds”. An inert roundwould be placed in the guns magazine amongst live rounds in a placeusually unknown to the firer, so that when the trigger was pulled withthe inert round in the breach of the gun, the result of the round notgoing off allowed the firer to see if he had flinched. By bringing theaction of this subconscious movement in to the conscious awareness ofthe firer, it improves his concentration on this aspect of firing of thegun.

There are many disadvantages with traditional methods, such as needingto stop firing to be check your target for a flinched shot or needing tostop firing to eject an inert round. Thus, it is not very suitable forfiring practices which are time constrained.

Recently more sophisticated electronic based training systems have beendeveloped, as disclosed in U.S. Pat. No. 8,668,496. This US patentdiscloses a training system may have a handheld computing deviceconfigured to receive a data input from an input device. The inputdevice may be a sensor capable of measuring a condition relating to thetraining. An analysis module in electronic communication with thehandheld computing device is configured to interpret the data input fromthe input device and configured provide a feedback output related to theexecution of the goals of the training system. Based on this feedback, atrainee or trainer may adjust the training program to enhance thetrained skills. However this training system does not provide real timefeedback and does not effectively address the problem of flinch ormovement of a user before firing. Moreover the training device requiresit to be mechanically coupled to the fire arm which changes the weightof the firearm which leads to an unrealistic training environment.

It is therefore an object to provide an improved system and method fordetection of unintended movement for training of firearm use.

SUMMARY

According to the invention there is provided, as set out in the appendedclaims, a wearable device for user firearm training comprising:

-   -   at least one sensor for detecting movement in the users hand or        arm;    -   a module for detecting a firing event;    -   a module for processing data from the at least one sensor such        that movement by the user can be analysed; and    -   a module for producing feedback to the user based on said        analysis wherein the feedback can be at least one of a audio or        tactile feedback to the user in real-time to indicate a movement        of the users hand or arm has occurred before the detected firing        event.

Accordingly several advantages of one or more aspects of the inventionare as follows:

Immediate feedback of having fired incorrectly is provided to the useror firer without having to stop to check the target or a display devicesuch as a phone, PDA or computer.

When specifically training for flinch, such as with inert rounds, firersdo not have to eject inert rounds from the chamber before continuing topractice.

When specifically training for flinch, as opposed to using inert rounds,feedback is provided on every round fired.

When specifically training for flinch, as opposed to using inert rounds,firing practices are continuous and the firer is not required to haltthe practice to remove the inert round from the chamber of the weapon.

There is no modification to the gun, which may affect the balance of thegun, or may not be allowed if the gun is the property of an employer, asis often the case with security forces, or if the gun is used forcompetition shooting.

There is no modification to the gun, allowing the firer to train forun-holstering a gun at the beginning of a shooting practice.

When firing in rapid succession during a firing practice with thisdevice, the firer can distinguish if a round was fired incorrectly dueto the aim being off at the time of firing or if it was due to a flinch.

The device is completely separate from the gun of the firer, and allowsthe firer to use an unmodified gun, or guns, with unmodified ammunitionwhich allows training to be more realistic.

The device also allows for the firer to use it with multiple guns, whichis a feature of some competitions.

Making the unconscious action of flinching known to the firer allows thefirer to take remedial action to counteract the flinch effect.

In one embodiment the at least one sensor comprises an IMU sensor, saidsensor having at least one accelerometer and/or at least one gyroscope.

In one embodiment the at least one sensor comprises an EMG sensor, saidsensor capable of detecting movement forward of the wrist.

In one embodiment the module to detect a firing event comprises amicrophone.

In one embodiment the module to detect a firing event comprises asignature measurement of an accelerometer and/or gyroscope.

In one embodiment the tactile feedback is provided by a vibratingsensor/motor device.

In one embodiment the audio feedback is provided to the user via aspeaker or headphone.

In one embodiment the feedback module comprises a visual feedbackindicator.

In one embodiment the visual feedback indicator comprises a lightsource, such as a LED light.

In one embodiment the wearable device can be configured toauto-calibrate based on the at least one sensor XYZ axis and ameasurement that represents the firearm is being held steady for aiming.

In one embodiment the wearable device may be configured to recognise anaccelerometer and/or gyroscope signature that represents theun-holstering of the firearm from a holster.

In one embodiment the device is configured to adjust threshold levels ofthe at least one sensor for different firing environments or acceptablethreshold levels of firer movement.

In one embodiment the wearable device comprises a glove.

In one embodiment the wearable device comprises a ring shaped deviceconfigured to be worn on a finger, or hand or arm of the user.

In another aspect of the invention there is provided a method for userfirearm training using a wearable device comprising the steps of:

-   -   detecting movement in the users hand or arm using at least one        sensor; detecting a firing event from a firearm;    -   processing data from the at least one sensor such that movement        by the user can be analysed; and    -   producing a feedback to the user based on said analysis wherein        the feedback can be an audio or tactile feedback to the user in        real-time to indicate a movement of the users hand or arm has        occurred before the detected firing event.

According to another aspect of the invention there is provided awearable device on a user comprising:

-   -   means for detecting movement in the users hand or arm;    -   means for detecting a firing event;    -   means for processing data from sensors so movement by the firer        can be analyzed; and    -   means for producing feedback to the firer based on analysis of        said sensors.

There is also provided a computer program comprising programinstructions for causing a computer program to carry out the abovemethod which may be embodied on a record medium, carrier signal orread-only memory.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will be more clearly understood from the followingdescription of an embodiment thereof, given by way of example only, withreference to the accompanying drawings, in which:

FIG. 1 shows a diagram of a first embodiment or a wearable device basedaround a glove or the like such as a strap according to a first aspect;

FIG. 2 shows a diagram of a second embodiment based around a ring, wornon a finger of a user, according to a second aspect of the invention;

FIG. 3 shows a diagram of a third embodiment according to a third aspectof the invention, worn on the arm of a user or firer configured todetect movement forward of the wrist by means of EMG signals whichsignal hand movement; and

FIG. 4 illustrates a flow chart illustrating an example operation of thewearable device of the invention in use.

DETAILED DESCRIPTION OF THE DRAWINGS

Embodiments of the present invention provide a system to detectincorrect movement while a person is firing and give the personreal-time feedback. The wearable device can be worn forward of theperson's wrist to detect movements of the hand(s), wrist(s), arm(s) andshoulder(s). Sensors in the wearable device for the purpose of detectingflinch such as accelerometers, gyroscopes, or EMG, or a combination ofsuch, constantly measure the movement of the firers hands, wrists, armsand shoulders, the operation of which is discussed in more detail below.

The wearable device is shown in the several views of the drawings. Theembodiments shown are not limited in its application to the details ofconstruction and to the arrangements of the components set forth in thefollowing description or illustrated in the drawings. Other embodimentsand aspects can be practiced and carried out in various ways. Also thephraseology and terminology employed are for the purpose of descriptionsand should not be regarded as limiting their scope.

FIG. 1 shows a diagram of a first embodiment based around a glove or thelike such as a strap, which could be worn on either the gripping hand orthe supporting hand of the firer. The glove may be made out of materialsthat can house electronic components. The glove can incorporate one ormore of the following components: a micro USB port 101, a re-chargeablebattery 102, a wireless adapter 103 such as a Bluetooth wirelessconnection, a vibration motor 104, Microphone 105, a processor 106, anInertial Measurement Unit (IMU) 107, and a RGB LED 108. The glove can beworn by a user that is firing a gun or firearm.

The electronic components of the glove can detect movement of thefirer's hands or arms such as an IMU or EMG sensor 107, which mayconsist of at least one accelerometer and/or at least one gyroscope. Ameans to detect a gunshot can be provided by a microphone or by thesignature of the accelerometer or gyroscope or EMG or a combination ofsuch 105. A means to process the data from the sensors such as aprocesser 106 that can be embodied as a microchip or ASIC chip. A meansis provided to enable feedback to the firer, such as using a wirelessadapter 103, that can operate on the Bluetooth standard or otherwireless communication format. The vibration motor 104 or the LED 108can provide a tactile or visible indicator to the user or firer toindicate that a flinch has occurred during use of a firearm. Thewearable device can have a micro USB port 101 is adapted to recharge abattery housed in the glove. The micro USB port 101 can be used toconnect to a computer which could be used to adjust threshold levels ofthe sensors for different firing environments or acceptable thresholdlevels of firer movement.

FIG. 2 shows a diagram of a second embodiment according to a secondaspect of the invention. This embodiment is based around an elasticatedband of material or a plastic material which is of size to be worn on afinger, or hand or arm of the firer. This alternative embodiment has thesame electronic components as the first embodiment. The ring device canincorporate one or more of the following components: Wireless charginginductance coil 201, Rechargeable battery 202, Bluetooth wirelessadapter 203, Memory 204, Microphone 205, Processor 206, or IMU 207.

This embodiment can be placed either above the wrist or below the wristto determine if the flinch movement originates from the shoulder regionor from the wrist or finger. The embodiment shown in FIG. 2 is basedaround a ring, which could be worn on either the gripping hand or thesupporting hand of the firer. The ring may be made out of materials thatcan house electronic components. The electronic components of the ringcomprises a means to detect movement of the firers hands or arms such asusing an IMU sensor or EMG sensor 207. A means to detect a gunshot suchas a microphone 205 or by the signature of the accelerometer orgyroscope or a combination of such is provided. A means to process thedata from the sensors such as a processing chip 206. A means to providefeedback to the firer such as a vibration motor 204, means tocommunicate with an external processor such as a Bluetooth wirelessadapter, or a LED device to provide a visual feedback in the form of alight flashing light or different light colors. It may have a wirelesscharging unit which can recharge a battery housed in the ring. TheBluetooth wireless adapter port can be used to connect to a computerwhich can be used to adjust threshold levels of the sensors fordifferent firing environments or acceptable threshold levels of firermovement.

The wearable device can be configured to constantly sense for thedetection of a firing event, such as a sound above a certain amplitudethreshold, an acceleration velocity or a rotation velocity that canindicate a gunshot or a combination of such.

When the wearable device has detected what is deemed to be a firingevent, it analyzes the movement data of the firer within a specificperiod of time prior to the firing event. If the movement data of thatfixed period indicates movement of the firers hand or arms to be above acertain threshold of acceleration, angle change or muscle response, thenthe firer is deemed to have flinched.

A module for producing feedback to the user in real time based on theanalysis can be factored into the device. The feedback can be at leastone of an audio or tactile or visual feedback to the user in real-timeto indicate a movement of the users hand or arm has occurred before thedetected firing event. By ‘real-time’ it is meant that the feedback canbe provided to the user within a few seconds of a firing event withoutthe need for the user to move their line of sight away from the gun orotherwise disturb their shooting practice. In other words feedback ondetected flinch movement can be provided to the user/firer of thefirearm between shots in real time. Calculation of the flinch movementcan be determined within milliseconds depending on the processor used.

The wearable device can then provide feedback to the firer to make thefirer aware of the flinch, in some instances by means of audible tonewhich may be sent via a computing device such as a smartphone or thevibrating motor 204 in the wearable device, or directly to a set ofwireless earphones (using a Bluetooth communication or other wirelessprotocol), and/or it can record this movement for later analysis.

The wearable device is completely separate from the gun of the firer,and allows the firer to use an unmodified gun, or guns, with unmodifiedammunition. It also allows for the firer to use it with multiple guns,which is a feature of some competitions.

The wearable device can be configured to be in wireless electroniccommunication with a computing device such as a smartphone, a tablet ora laptop. The wearable device can send biometric data collected from thewearable devices sensors and this data can be manipulated and displayedby the computing device and displayed to the firer.

FIG. 3 shows an alternative embodiment of the invention and similar toFIGS. 1 and 2. This embodiment is based around an elasticated band ofmaterial or plastic material which is of size to be worn on the arm ofthe firer. The elasticated band wearable device can incorporate one ormore of the following components: a micro USB 301, a rechargeablebattery 302, wireless adapter 303, a vibration motor 304, Processor 305,and at least one EMG sensor 306.

This embodiment has at least one EMG sensor spaced around the band ofmaterial so as to determine movement in the firer's hand or arm. Thisreplaces the IMU described in the first two embodiments with respect toFIGS. 1 and 2. The remaining components are similar to the firstembodiment.

EXAMPLE OPERATION

In operation the wearable device worn by the firer will perform a numberof functions as described by the flow diagram in FIG. 4. The device isworn by the firer during a firing practice in step 400. The device'smovement sensors constantly track the rate of movement of the firershand(s) and/or arm(s). The device sensors will constantly monitor for afiring event, in various embodiments using a microphone, accelerometeror gyroscope, as described above, to detect a distinctive amplitudethreshold representing a firing event.

The data from the sensors is processed by the processing chip, whichmonitors for a firing event. When a firing event is detected in step401, the processing chip analyzes the movement data for a specific timeperiod prior to the firing event 402. If the movement data prior to thefiring event is above a specific threshold of acceleration, angle changeor muscle response, the processing chip produces an output such as avibration or a signal to an external processor 403 a. In someembodiments, this output signals for a vibration motor in the devicethat the user or firer can physically feel or an audible tone to beproduced through an external computer. In another embodiment a visibleindicate maybe provided in the form of a flashing light to indicate tothe user that a flinch is detected, as shown in FIG. 1. In step 403 b ifthe signal is below a signal threshold then the device continues tomonitor for future firing events.

It will be appreciated that the wearable device is configured to workwith a computing device such as a standalone personal computer or smartphone device. The invention can be embodied using a combination ofhardware and software. A hardware algorithm can detect gunshot through asignature using Kalman filter combination of accelerometer and gyroscopedata above a threshold value. This can be combined with other factorssuch as was the firearm steady and level prior to gunshot event,indicating gun being aimed. If so, hardware passes samples for x timeperiod prior to gunshot event to external computer for further analysis.An external computer or device analyses for movement above flinchthreshold, provides feedback if flinch deemed to have occurred. In oneillustrative embodiment a software module can run a routine on thedevice or on a remote system to recognise a gunshot signatureimplementing the steps shown in FIG. 4.

The wearable device can be configured to auto-calibrate itself on theIMUs XYZ axis based on the sensors signature that represents the gun isbeing held steady for aiming. The wearable device may be configured torecognise an accelerometer and/or gyroscope signature that representsthe un-holstering of the gun from a holster. This may be used torecognise the beginning of a live firing practice.

In the context of the present invention the wearable device hereinbeforedescribed can be applied to firearm and weapon training, and can be usedin connection with any weapon or weapon system that requires flinchanalysis and includes crossbow, bow and arrow weapons and the like.

The embodiments in the invention described with reference to thedrawings comprise a computer apparatus and/or processes performed in acomputer apparatus. However, the invention also extends to computerprograms, particularly computer programs stored on or in a carrieradapted to bring the invention into practice. The program may be in theform of source code, object code, or a code intermediate source andobject code, such as in partially compiled form or in any other formsuitable for use in the implementation of the method according to theinvention. The carrier may comprise a storage medium such as ROM, e.g.CD ROM, or magnetic recording medium, e.g. a memory stick or hard disk.The carrier may be an electrical or optical signal which may betransmitted via an electrical or an optical cable or by radio or othermeans.

In the specification the terms “comprise, comprises, comprised andcomprising” or any variation thereof and the terms include, includes,included and including” or any variation thereof are considered to betotally interchangeable and they should all be afforded the widestpossible interpretation and vice versa.

The invention is not limited to the embodiments hereinbefore describedbut may be varied in both construction and detail.

1. A wearable device for user firearm training comprising: at least onesensor for detecting movement in the users hand or arm; a module fordetecting a firing event; a module for processing data from the at leastone sensor such that movement by the user can be analyzed; and a modulefor producing feedback to the user based on said analysis wherein thefeedback is at least one of an audio or tactile feedback to the user inreal-time to indicate a movement of the users hand or arm has occurredbefore the detected firing event.
 2. The device of claim 1 wherein theat least one sensor comprises an IMU sensor, said sensor having at leastone accelerometer and/or at least one gyroscope.
 3. The device of claim1 wherein the at least one sensor comprises an EMG sensor, said sensorcapable of detecting movement forward of the users wrist.
 4. The deviceof claim 1 wherein the module to detect a firing event comprises amicrophone.
 5. The device of claim 1 wherein the module to detect afiring event comprises a signature measurement of an accelerometerand/or gyroscope.
 6. The device of claim 1 wherein the tactile feedbackis provided by a vibrating sensor/motor device.
 7. The device of claim 1wherein the audio feedback is provided to the user via a speaker orheadphone.
 8. The device of claim 1 wherein the feedback modulecomprises a visual feedback indicator.
 9. The device of claim 8 whereinthe visual feedback indicator comprises a light source, such as a LEDlight.
 10. The device of claim 1 wherein the wearable device can beconfigured to auto-calibrate based on the at least one sensor XYZ axisand a measurement that represents the firearm is being held steady foraiming.
 11. The device of claim 10 wherein the wearable device may beconfigured to recognise an accelerometer and/or gyroscope signature thatrepresents the un-holstering of the firearm from a holster.
 12. Thedevice of claim 1 wherein the device is configured to adjust thresholdlevels of the at least one sensor for different firing environments oracceptable threshold levels of firer movement.
 13. The device of claim 1wherein the wearable device comprises a glove.
 14. The device of claim 1wherein the wearable device comprises a ring shaped device configured tobe worn on a finger, or hand or arm of the user.
 15. A method for userfirearm training using a wearable device comprising the steps of:detecting movement in the users hand or arm using at least one sensor;detecting a firing event from a firearm; processing data from the atleast one sensor such that movement by the user can be analysed; andproducing a feedback to the user based on said analysis wherein thefeedback can be an audio or tactile feedback to the user in real-time toindicate a movement of the users hand or arm has occurred before thedetected firing event.
 16. A computer program comprising programinstructions for causing a computer to perform the method of claim 15.